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DETAILED ACTION 
Continued Examination Under 37 CFR LI 14 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.114. Applicant's submission filed on 12/4/2006 has been entered. 

Response to Arguments 

2. Applicant's arguments filed 12/04/2006 have been fully considered but they are not 
persuasive. 

As to Applicant's arguments regarding the independent claims and the Abe in view of 
Haavisto rejection, Applicant asserts, "...the Examiner's office action fails to show where in Abe 
and/or Haavisto can be found "a converter that generates an average intensity value for each of 
the plurality of color components,". . ." The examiner respectfully disagrees with this and submits 
that in Figure 1 , Haavisto shows an A/D converter "54" converting the output from a light 
measuring sensor 6 3 3". This was cited on p. 4, Line 1 of the latest office action. Before 
explaining the examiner's interpretation of Haavisto, the examiner would like to consider 
applicant's response to the examiner remarks in the latest office action. On page 7 in the 
Remarks, Applicant writes, ". . .the Office action is drawing improper conclusions from 
Applicants' specification and thereby imposing improper limitations on Applicants' invention..." 
Without acquiescing as to legitimacy of this contention, the examiner's interpretation of 
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Haavisto is that the output of the A/D converter is an average value. More specifically, Haavisto 
provides an average of only one signal at the output of the A/D converter, which, as logically 
follows, is the input signal in digital form. Further, Applicant argues, "For example, contrary to 
the Office action assertion that the average intensity value is simply a digital signal that is an 
average of only one signal a person of ordinary skill in the art will understand from the A-D 
conversion aspect that it is improper to draw such a conclusion. As is known, an A-D converter 
typically uses a sampling clock to sample an analog signal at various sampling instants and 
generate therefrom, a series of digital signals. In this case, the analog signal produced by color 
sensor 1 3 will be directly dependent upon the light incident on color sensor 1 3 and would 
typically, vary over time (even assuming in arguendo that the photo sensor produces "one" 
signal as alleged in the Office action)." While it is true that an analog signal produced from a 
color sensor varies over time, a person of ordinary skill in the art would not recognize sampling 
the signal over that time period and averaging the samples as a well-known process in the art. It 
is not clear from the specification how applicant is arriving at an average value. The specification 
does not have support for sampling and averaging a signal from the photodiode, because as 
mentioned above, this is not a well-known process in the art. Thus, the examiner submits that the 
average value being an average of only one signal is a reasonable interpretation in light of this 
disclosure. 

Claim Rejections -55 (JSC §103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the. 
manner in which the invention was made. 

3. Claims 21 and 26-31 are rejected under 35 U.S.C. 103(a) as being unpatentable over Abe 
(US 2001/0030694) in view of Haavisto (US 2001/0007470). 

As to claim 21, Abe teaches an imaging device (Figure 1, digital still camera "100") 
comprising: a color filter array configured to generate a first set of red-green-blue (RGB) values 
from light incident upon the color filter array (Figure 3, CCD "1 16"; [0030], Lines 1-9); a first 
analog processing and analog-to-digital (A-D) conversion unit configured to receive the first set 
of RGB values and generate in response thereto, a set of digital RGB signals (Figure 3, A/D 
"222"); a color sensor that is independent of the color filter array (Figure 3, color temperature 
sensor "120" separate from the CCD "116"), the color sensor configured to generate a second set 
of RGB values from light incident upon the color sensor ([0023], Lines 6-9); and a white balance 
unit that uses intensity values for the RGB values to generate white balance information 
([0036]). Although it is not stated explicitly, Official Notice is taken that the concept of 
amplifying signals accumulated on a photo sensor is well known and expected in the art. One of 
ordinary skill in the art would be motivated to do this, because it produces a more manageable 
value for processing (The amplifier is the second analog processing circuit.). The claim differs 
from Abe in that it further requires A-D conversion unit configured to receive the second set of 
RGB values and generate in response thereto, a set of average RGB signals. 

In the same field of endeavor, Haavisto teaches a camera (Figure 1) performing white 
balance on an image taken by an image pickup unit. The camera utilizes a light measuring 
sensor, separate from the image pickup unit, that provides an overall intensity of the illuminating 
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light used for balancing the intensities of the color components of the image produced by the 
image pickup unit ([0037]). The signal representing the overall intensity is accumulated on a 
photodiode. An analog-to-digital converter (Figure 1, "54") then converts that signal to a digital 
signal that is then forwarded to a control unit to perform the aforementioned white balancing 
([0037]). In light of the teaching of Haavisto, it would have been obvious to convert the RGB 
signals accumulated in the color temperature sensor of Abe to digital signals before being used 
for color temperature calculation, because an artisan of ordinary skill in the art would recognize 
the numerous advantages of utilizing digital signals in calculation. 

As to claim 26, Abe, as modified by Haavisto, teaches the imaging device of claim 21, 
wherein the first set of RGB values provides pixel-level information of a captured image (see 
Abe, [0030], Lines 1-9) and the second set of RGB values provides proportion information 
between the red, green and blue components in light incident upon the color sensor (see Abe, 
[0023], Lines 6-12). 

As to claim 27, Abe, as modified by Haavisto, teaches the imaging device of claim 26, 
wherein the proportion information comprises a first voltage representing a proportion of the red 
component, a second voltage representing a proportion of the green component, and a third 
voltage representing a proportion of the blue component (A voltage is inherent in photodiode 
signal generation.), . 

As to claim 28, Abe, as modified by Haavisto, teaches the imaging device of claim 27, 
wherein each of the first, second, and third voltages is a DC voltage derived from a supply 
voltage of the color sensor (see Abe, Figure 3, power switch "308"). 
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As to claim 29, Abe, as modified by Haavisto, teaches the imaging device of claim 27, 
wherein the set of average RGB signals generated by the second analog processing and A-D 
conversion unit comprises a digital representation of each of the first, second, and third voltages 
(see Haavisto, Figure 1 , A/D "54"). 

As to claim 30, Abe, as modified by Haavisto, teaches the imaging device of claim 27, 
wherein the color sensor comprises: a red color filter coupled to a first photo sensor, the red color 
filter selected to propagate the red component in light incident upon the color sensor; a green 
color filter coupled to a second photo sensor, the green color filter selected to propagate the 
green component in light incident upon the color sensor; and a blue color filter coupled to a third 
photo sensor, the blue color filter selected to propagate the blue component in light incident upon 
the color sensor (see Abe, [0030], Lines 6-9). 

As to claim 31, Abe, as modified by Haavisto, teaches the imaging device of claim 26. 
Although it is not stated explicitly, Official Notice is taken that color interpolation circuits, 
which provide RGB values for each pixel are well known and expected in the art. One of 
ordinary skill in the art would recognize that this would allow a RGB value for each pixel to be 
obtained without providing 3 separate sensors. 

4. Claims 22-25 and 32-40 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Abe (US 2001/0030694) in view of Haavisto (US 2001/0007470) and further in view of Ikeda 
(US 2002/0018129). 

As to claim 22, Abe, as modified by Haavisto, teaches the imaging device of claim 21. 
The claim differs from Abe, as modified by Haavisto, in that it further requires a color 
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interpolation unit configured in part, to receive the set of average RGB signals generated by the 
second analog processing and A-D conversion unit and forward the set of average RGB signals 
to the white balance unit without further processing, thereby eliminating a processing time in the 
color interpolation unit. 

In the same field of endeavor, Ikeda teaches an apparatus performing white balance. The 
apparatus also includes a signal processing circuit comprising a color interpolation unit and 
white balance circuit. Signals used for white balance are forwarded to the signal processing 
circuit (color interpolation unit) and then to the white balancing unit (Figure 1, [0031]). In light 
of the teaching, it would have been obvious to one of ordinary to include the color interpolation 
circuit before the white balance circuit in Abe, because an artisan of ordinary skill in the art 
would recognize that this would provide the white balancing unit with RGB information for all 
pixels rather than some, thereby obtaining a truer white balance value. 

As to claim 23, Abe, as modified by Haavisto and Ikeda, teaches the imaging device of 
claim 22, wherein the set of average RGB signals is a digital set of average RGB signals (see 
Haavisto, Figure 1, output of A/D "54"). 

As to claim 24, Abe teaches an imaging device (Figure 1, digital still camera "100") 
comprising: a first image processing path comprising: a color filter array configured to generate a 
first set of red-green-blue (RGB) values from light incident upon the color filter array (Figure 3, 
CCD "116"; [0030], Lines 1-9); and a first analog processing and analog-to-digital (A-D) 
conversion unit configured to receive the first set of RGB values and generate in response 
thereto, a set of RGB signals (Figure 3, A/D "222"); a second image processing path that is 
parallel to, and independent of, the first image processing path, the second image processing path 
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comprising: a color sensor that is independent of the color filter array (Figure 3, color 
temperature sensor "120" separate from the CCD "1 16"), the color sensor configured to generate 
a second set of RGB values from light incident upon the color sensor ([0023], Lines 6-9); and a 
common image processing path comprising: a white balance unit that uses intensity values for 
the RGB values to generate white balance information ([0036]). Although it is not stated 
explicitly, Official Notice is taken that the concept of amplifying signals accumulated on a photo 
sensor is well known and expected in the art. One of ordinary skill in the art would be motivated 
to do this, because it produces a more manageable value for processing (The amplifier is the 
second analog processing circuit). The claim differs from Abe in that it further requires an 
analog-to-digital (A-D) conversion unit configured to receive the second set of RGB values and 
generate in response thereto, a set of average RGB values and a color interpolation unit 
configured to receive the set of average RGB values generated by the second analog processing 
and A-D conversion unit and forward the set of average RGB values to the white balance unit 
without further processing, thereby eliminating a processing time in the color interpolation unit. 

In the same field of endeavor, Haavisto teaches a camera (Figure 1) performing white 
balance on an image taken by an image pickup unit. The camera utilizes a light measuring 
sensor, separate from the image pickup unit, that provides an overall intensity of the illuminating 
light used for balancing the intensities of the color components of the image produced by the 
image pickup unit ([0037]). The signal representing the overall intensity is accumulated on a 
photodiode. An analog-to-digital converter (Figure 1, "54") then converts that signal to a digital 
signal that is then forwarded to a control unit to perform the aforementioned white balancing 
([0037]). In light of the teaching of Haavisto, it would have been obvious to convert the RGB 
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signals accumulated in the color temperature sensor of Abe to digital signals before being used 
for color temperature calculation, because an artisan of ordinary skill in the art would recognize 
the numerous advantages of utilizing digital signals in calculation. 

In the same field of endeavor, Ikeda teaches an apparatus performing white balance. The 
apparatus also includes a signal processing circuit comprising a color interpolation unit and 
white balance circuit. Signals used for white balance are forwarded to the signal processing 
circuit (color interpolation unit) and then to the white balancing unit (Figure 1, [0031]). In light 
of the teaching, it would have been obvious to one of ordinary to include the color interpolation 
circuit before the white balance circuit in Abe, because an artisan of ordinary skill in the art 
would recognize that this would provide the white balancing unit with RGB information for all 
pixels rather than some, thereby obtaining a truer white balance value. 

As to claim 25, Abe, as modified by Haavisto and Ikeda, teaches a method of imaging 
(Figure 3, digital still camera "100"), the method comprising: providing a color filter array 
(Figure 1, CCD "116"); providing a color sensor that is independent of the color filter array 
(Figure 3, color temperature sensor "120" separate from the CCD "116"); generating a first set of 
red-green-blue (RGB) values from light incident upon the color filter array ([0030], Lines 1-9); 
converting the first set of RGB values into a set of digital RGB signals (Figure 3, A/D "222"); 
generating a second set of RGB values from light incident upon the color sensor ([0023], Lines 
6-9), the second set of RGB values being independent of the first set of RGB values (Figure 3, 
color temperature sensor "120" separate from the CCD "116"); providing a white balance unit 
([0036]); receiving in the white balance unit, the set of average RGB signals from the color 
interpolation unit; and generating in the white balance unit, white balance information from the 
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set of average RGB signals ([0042]). The claim differs from Abe in that it further requires the 
steps of converting the second set of RGB values into a set of average RGB signals; providing a 
color interpolation unit; propagating the set of average RGB signals through the color 
interpretation unit without processing in the color interpretation unit, thereby eliminating a 
processing time in the color interpolation unit. 

In the same field of endeavor, Haavisto teaches a camera (Figure 1) performing white 
balance on an image taken by an image pickup unit. The camera utilizes a light measuring 
sensor, separate from the image pickup unit, that provides an overall intensity of the illuminating 
light used for balancing the intensities of the color components of the image produced by the 
image pickup unit ([0037]). The signal representing the overall intensity is accumulated on a 
photodiode. An analog-to-digital converter (Figure 1, "54") then converts that signal to a digital 
signal that is then forwarded to a control unit to perform the aforementioned white balancing 
([0037]). In light of the teaching of Haavisto, it would have been obvious to convert the RGB 
signals accumulated in the color temperature sensor of Abe to digital signals before being used 
for color temperature calculation, because an artisan of ordinary skill in the art would recognize 
the numerous advantages of utilizing digital signals in calculation. 

In the same field of endeavor, Ikeda teaches an apparatus performing white balance. The 
apparatus also includes a signal processing circuit comprising a color interpolation unit and 
white balance circuit. Signals used for white balance are forwarded to the signal processing 
circuit (color interpolation unit) and then to the white balancing unit (Figure 1, [0031]). In light 
of the teaching, it would have been obvious to one of ordinary to include the color interpolation 
circuit before the white balance circuit in Abe, because an artisan of ordinary skill in the art 
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would recognize that this would provide the white balancing unit with RGB information for all 
pixels rather than some, thereby obtaining a truer white balance value. 

As to claim 32, Abe, as modified by Haavisto and Ikeda, teaches the method of claim 25, 
wherein generating the first set of RGB values comprises generating pixel-level information of a 
captured image ([0030], Lines 1-9) and generating the second set of RGB values comprises 
generating proportion information between the red, green and blue components in light incident 
upon the color sensor ([0023], Lines 6-12). 

As to claim 33, Abe, as modified by Haavisto and Ikeda, teaches the method of claim 32, 
wherein generating of proportion information comprises generating of a first voltage 
representing a proportion of the red component, generating a second voltage representing a 
proportion of the green component, and generating a third voltage representing a proportion of 
the blue component (A voltage is inherent in photodiode signal generation.). 

As to claim 34, Abe, as modified by Haavisto and Ikeda, teaches the method of claim 33, 
wherein converting the second set of RGB values into the set of average RGB signals comprises 
generation of a digital representation of each of the first, second, and third voltages (see 
Haavisto, Figure 1, output of A/D "54"). 

As to claim 35, Abe, as modified by Haavisto and Ikeda, teaches the method of claim 33, 
further comprising: coupling a DC voltage into the color sensor; and generating the first, second, 
and third voltages from the DC voltage (see Abe, Figure 3, power switch "308"). 

As to claim 36, Abe, as modified by Haavisto and Ikeda, teaches the method of claim 33, 
wherein providing the color sensor comprises: coupling a red color filter to a first photo sensor, 
the red color filter selected to propagate the red component in light incident upon the color 
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sensor; coupling a green color filter to a second photo sensor, the green color filter selected to 
propagate the green component in light incident upon the color sensor; and coupling a blue color 
filter to a third photo sensor, the blue color filter selected to propagate the blue component in 
light incident upon the color sensor (see Abe, [0023], Lines 6-12). 

As to claim 37, Abe, as modified by Haavisto and Ikeda, teaches the method of claim 32. 
Although it is not stated explicitly, Official Notice is taken that color interpolation circuits, 
which provide RGB values for each pixel are well known and expected in the art. One of 
ordinary skill in the art would recognize that this would allow a RGB value for each pixel to be 
obtained without providing 3 separate sensors. 

As to claim 38, Abe, as modified by Haavisto and Ikeda, teaches the imaging device of 
claim 24, wherein the first set of RGB values provides pixel-level information of a captured 
image (see Abe, [0030], Lines 1-9) and the second set of RGB values provides proportion 
information between the red, green and blue components in light incident upon the color sensor 
([0023], Lines 6-12). 

As to claim 39, Abe, as modified by Haavisto and Ikeda, teaches the imaging device of 
claim 38, wherein the proportion information comprises a first voltage representing a proportion 
of the red component, a second voltage representing a proportion of the green component, and a 
third voltage representing a proportion of the blue component (A voltage is inherent in 
photodiode signal generation. ) . 

As to claim 40, Abe, as modified by Haavisto and Ikeda, teaches the imaging device of 
claim 38. Although it is not stated explicitly, Official Notice is taken that color interpolation 
circuits, which provide RGB values for each pixel are well known and expected in the art. One 
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of ordinary skill in the art would recognize that this would allow a RGB value for each pixel to 
be obtained without providing 3 separate sensors. 



Conclusion 

5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Anthony J. Daniels whose telephone number is (571) 272-7362. 
The examiner can normally be reached on 8:00 A.M. - 5:30 P.M.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ngoc-Yen Vu can be reached on (571) 272-7320. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

AD 

3/8/2007 
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